PATENT COOPERATION TREATY 

FCT 

INTERNATIONAL SEARCH REPORT 
(PCT Article 18 and Rules 43 and 44) 




Applicant's or agenf s file reference 

CM00641P/CT 


FOR FURTHER see Notification of Transmittal of International Search Report 

(Form PCT/ISA/220) as well as, where applicable, item 5 below. 

ACTIO M 


International application No. 
PCT/EP 01/08396 


International filing date (day/month/year) 

19/07/2001 


(Earliest) Priority Date (day/month/year) 

19/07/2000 


Applicant 

MOTOROLA INC 



This International Search Report has been prepared by this International Searching Authority and is transi 
according to Article 18. A copy is being transmitted to the International Bureau. 

This International Search Report consists of a total of 4 sheets. 

|X] It is also accompanied by a copy of each prior art document cited in this report. 



JUL 2 6 2002 

Jechnology Center 2 



1 . Basis of the report 

a. With regard to the language, the international search was carried out on the basis of the international application in the 
language in which it was filed, unless otherwise indicated under this item. 

| I the international search was carried out on the basis of a translation of the international application furnished to this 
1 — Authority (Rule 23.1(b)). 

b. With regard to any nucleotide and/or amino acid sequence disclosed in the international application, the international search 
was carried out on the basis of the sequence listing : 
[ | contained in the international application in written form. 

filed together with the international application in computer readable form. 

furnished subsequently to this Authority in written form. 

furnished subsequently to this Authority in computer readble form. 



2. 
3. 



□ 
□ 
□ 
□ 

□ 

□ 
□ 



the statement that the subsequently furnished written sequence listing does not go beyond the disclosure in the 
international application as filed has been furnished. 

the statement that the information recorded in computer readable form is identical to the written sequence listing has been 
furnished 

Certain claims were found unsearchable (See Box I). 
Unity of invention is lacking (see Box II). 



4. With regard to the title, 

| | the text is approved as submitted by the applicant. 
|X~| the text has been established by this Authority to read as follows: 
APPARATUS AND METHOD FOR VIDEO CODING AND TRANSMISSION 



With regard to the abstract, 

[X] the text is approved as submitted by the applicant. 

□ the text has been established, according to Rule 38.2(b), by this Authority as it appears in Box III. The applicant may, 
within one month from the date of mailing of this international search report, submit comments to this Authority. 

The figure of the drawings to be published with the abstract is Figure No. 3 



[X] as suggested by the applicant. [_] None of the figures. 

i 1 because the applicant failed to suggest a figure. 

! | because this figure better characterizes the invention. 



Form PCT/ISA/210 (first sheet) (July 1998) 



THIS PAGE BLANK (uspto) 



INTERNATIONAL SEARCH REPORT 



International Application No 

PCT/EP 01/08396 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC 7 H04N7/50 H04N7/30 



According to International Patent Classification (.PC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 

IPC 7 H04N 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practical, search terms used) 

EPO-Internal 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category ° Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



RIBAS-CORBERA J ET AL: "RATE CONTROL IN 
DCT VIDEO CODING FOR LOW-DELAY 
COMMUNICATIONS" 

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS 
FOR VIDEO TECHNOLOGY, IEEE INC. NEW YORK, 
US, 

vol. 9, no. 1, February 1999 (1999-02), 
pages 172-185, XP000802296 
ISSN: 1051-8215 
paragraph '00IV! 



EP 0 478 230 A (AMERICAN TELEPHONE & 
TELEGRAPH) 1 April 1992 (1992-04-01) 

column 3, line 42 -column 4, line 16; 
figure 3 



1-3, 

5-10, 

12-14 



4,11, 
15-50 

1-3, 

5-10, 

12-14 

4,11, 

15-50 



-/-- 



m 



Further documents are listed in the continuation of box C. 



Patent family members are listed in annex. 



° Special categories of cited documents : 

■A" document defining the general state of the art which is not 

considered to be of particular relevance 
a E a earlier document but published on or after the international 

filing date 

'L' document which may throw doubts on priority claim(s) or 
which is cited to establish the publication date of another 
citation or other special reason (as specified) 

'O' document referring to an oral disclosure, use, exhibition or 
other means 

■P' document published prior to the international filing date but 
later than the priority date claimed 



"T" later document published after the international filing date 
or priority date and not in conflict with the application but 
cited to understand the principle or theory underlying the 
invention 

'X' document of particular relevance; the claimed invention 
cannot be considered novel or cannot be considered to 
involve an inventive step when the document is taken alone 

•y document of particular relevance; the claimed invention 

cannot be considered to involve an inventive step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
in the art. 

document member of the same patent family 



Date of the actual completion of the international search 



24 April 2002 



Date of mailing of the international search report 



06/05/2002 



Name and mailing address of the ISA 

European Patent Office, P.B. 5818 Patentlaan 2 
NL - 2280 HV Rijswijk 
Tel. (+31-70) 340-2040, Tx. 31 651 epo nl, 
Fax: (+31-70) 340-3016 



Authorized officer 



Georgiou, G 



Fomn PCT7ISA/210 (second sheet) (July 1992) 



page 1 of 3 



THIS PAGE BLANK (uspto) 



INTERNATIONAL SEARCH REPORT 



International Application No 

PCT/EP 01/08396 



C.(Continuation) DOCUMENTS CONSIDERED TO BE RELEVANT 


Category ° 


^rlntirvn sxf riA^nmanf \ A/it h i r\Hi i^O t IAn VA/hora ^nnrnnri-atn Af thfl ralA\/ont ncacooflOC 

Oucllion or Qocurneni, wun inujuauuiitWiicre appropricue, 01 ine reievcuu paobdycb 


Rplpv/ant tr> r^lptm Mo 
ncicvaiu ikj Kyian 1 1 i>*w. 


X 


US 5 872 598 A (WELLS AARON ET AL) 


1-3, 




16 February 1999 (1999-02-16) 


5-10, 






12-14 


A 


column 4, line 54 -column 5, line 6 


4,11, 






15-50 


X 




BO TAO ET AL: "A rate-quantization model 


1-3, 




for MPEG encoders" 


5-10, 




IMAGE PROCESSING, 1997. PROCEEDINGS., 


12-14 




INTERNATIONAL CONFERENCE ON SANTA BARBARA, 






CA, USA 26-29 OCT. 1997, LOS ALAMITOS, CA, 






UoM, Ittt LUrlrUI . oUu , Uo , 






26 October 1997 (1997-10-26), pages 






338-341, XP010254176 






ISBN: 0-8186-8183-7 




A 


paragraph '02.3! 


4,11, 






15-50 


X 




US 5 144 426 A (FUJIKAWA WATARU ET AL) 


15-17, 




1 September 1992 (1992-09-01) 


21, 






23-26, 






30,32 


A 

M 


column o, line 01 column 0, line 11 


1 — 1 A 
1 14, 






18-20, 






22, 






27-29, 






31,33-50 




column 19, line 10 - line 33 




X 




LEE J-W ET AL: "TARGET BIT MATCHING FOR 


15,16, 




MPEG-2 VIDEO RATE CONTROL" 


24,25 




PROCEEDINGS OF IEEE TENCON'98. IEEE REGION 






10 INTERNATIONAL C0NFERENCE0N GLOBAL . 






CONNECTIVITY IN ENERGY, COMPUTER, 






COMMUNICATION AND CONTROL. NEW DEHLI, 






INDIA, DEC. 17 - 19, 1998, IEEE REGION 10 






ANNUAL CONFERENCE, NEW YORK, NY: IEEE, US, 






vol . 1 OF 2, 






1 7 rioromKor 1 QQQ ( 1 QQQ 1 O 1 7 ^ na/ioc 

1/ uecemuer iyyo v. i"i?o ic 1 / ) , pages 






66-69, XP000878387 






ISBN: 0-7803-4887-7 




A 


paragraph '02.2! 


1-14, 






17-23, 






26-50 


X 


EP 1 005 233 A (ST MICROELECTRONICS SRL) 


33-35, 




31 May 2000 (2000-05-31) 


37-44, 




46-50 


A 


page 11, line 1 - line 42 


1-32,36, 




45 




-/-- 





Form PCT/ISA/210 (continuation of second sheet) (July 1992) 



page 2 of 3 



T HIS PAGE BLANK (usptq. 



INTERNATIONAL SEARCH REPORT 



International Application No 

PCT/EP 01/08396 



C(Contlnuatlon) DOCUMENTS CONSIDERED TO BE RELEVANT 



Category ° Citation of document, with indication .where appropriate, of the relevant passages 



Relevant to claim No. 



TAE-YONG KIM ET AL: "An accurate rate 
control of MPEG video by rate-codewords 
modeling" 

CIRCUITS AND SYSTEMS, 1997. ISCAS '97., 
PROCEEDINGS OF 1997 IEEE INTERNATIONAL 
SYMPOSIUM ON HONG KONG 9-12 JUNE 1997, NEW 
YORK, NY, USA, IEEE, US, 

9 June 1997 (1997-06-09), pages 
1261-1264, XP010236445 
ISBN: 0-7803-3583-X 

paragraph '0004! 



1-50 



Form PCT/ISA/210 (continuation of second sheet) (July 1992) 



page 3 of 3 



THIS PAGE BUNK (uspto) - 



INTERNATIONAL SEARCH REPORT 

Information on patent family members 



International Application No 

PCT/EP 01/08396 



Patent document 
cited in search report 


Publication 
date 


Patent family 
member(s) 


Publication 
date 


EP 0478230 


A 


ni —HA— 1 QQ? 


us 


5038209 


A 




06-08-1991 








A A 

LA 


OACA1 AO 


A 1 

Al 




2o-uj-iyyt 








DE 


69124760 


Dl 




03-04-1997 








DE 


69124760 


T2 




12-06-1997 








EP 


0478230 


A2 




01-04-1992 








JP 


2509770 


B2 




26-06-1996 








JP 


4288776 


A 




13-10-1992 








KR 


9504118 


Bl 




25-04-1995 


US 5872598 


A 


16-02-1999 


NONE 











US 5144426 A 01-09-1992 



JP 


2026602 


C 


26-02-1996 


JP 


3214989 


A 


20-09-1991 


JP 


7061155 


B 


28-06-1995 


JP 


2629409 


B2 


09-07-1997 


JP 


4051689 


A 


20-02-1992 


JP 


2112450 


C 


21-11-1996 


JP 


3127581 


A 


30-05-1991 


JP 


7061153 


B 


28-06-1995 


JP 


2026592 


C 


26-02-1996 


JP 


3127582 


A 


30-05-1991 


JP 


7061154 


B 


28-06-1995 


us 


RE37091 


El 


13-03-2001 



EP 1005233 A 31-05-2000 EP 1005233 Al 31-05-2000 

JP 2000152237 A 30-05-2000 
US 6215820 Bl 10-04-2001 



Form PCT/ISA/210 (patent family annex) (Jufy 1992) 



1 
I 

* . 

■ I 

i 



THIS PAGE BLANK 



(usnoi 



D 



1/4 




'RIO 



PCT REQUEST 



CM00641P/CT 



Original (for SUBMISSION) - printed on 19.07.2001 09:59:12 AM 



0 


For receiving Office use only 




0-1 


International Application No. 




0-2 


International Filing Date 




0-3 


Name of receiving Office and "PCT 
International Application" 





0-4 

0-4-1 



Form - PCT/RO/101 PCT Request 

Prepared using 



PCT-EASY Version 2.91 
(updated 01.01.2001) 



0-5 



Petition 

The undersigned requests that the 
present international application be 
processed according to the Patent 
Cooperation Treaty 



0-6 



Receiving Office (specified by the 
applicant) 



European Patent Office (EPO) (RO/EP) 



0-7 



Applicant's or agent's file reference 



CM00641P/CT 



Title of invention 



APPARATUS AND METHOD FOR IMAGE 
TRANSMISSION 



II 

11-1 
II-2 
II-4 
II-5 



li-6 
U-7 
II-8 
II-9 



Applicant 

This person is: 
Applicant for 
Name 
Address: 



State of nationality 
State of residence 
Telephone No. 
Facsimile No. 



applicant only 

all designated States except US 

MOTOROLA INC 

13 03 E.Algonquin Road 

Schaumburg, IL 6 019 6 

United States of America 

US 

US 

00 847 576 3750 
00 847 576 3750 



IIM 

111-1-1 
1 1 1-1 -2 
IIM-4 
111-1-5 



111-1-6 
IIM-7 



Applicant and/or inventor 

This person is: 
Applicant for 
Name (LAST, First) 
Address: 



State of nationality 
State of residence 



applicant and inventor 

US only 

LALLET , Arthur 

Chemin De La Fourciere 

F-02260 Gergny 

France 

FR 

FR 





ME 



JUL 2001 




PAGE BUNK mm, 



2/4 

PCT REQUEST CM00641P/CT 

Original (for SUBMISSION) - printed on 19.07.2001 09:59:12 AM 



111 9 
111-/ 


Applicant and/or inventor 




II 1-2-1 


This person is: 


applicant and inventor 


1 1 


Applicant Tor 


US only 


111-2-4 


Name (LAST, First) 


HOBSON, Paola, Marcella 


II 1-2-5 


Address: 


12 Vaughans 

Alton , Hampshire GU34 2SQ 
united. Kingdom 


IH-2-6 


State of nationality 


GB 


111-2-7 


State of residence 


GB 


II 1-3 


Applicant and/or inventor 




111-3-1 


This person is: 


applicant and inventor 


III 9 O 


Applicant for 


US only 


111-3-4 


Name (LAST, First) 


MAY/ Anthony, Richard 




Muoress. 


15 Plough Way 

Winchester, Hampshire S022 4PX 
United Kingdom 


iii o a. 


State of nationality . 


GB 


II 1-3-7 


State of residence 


GB 


IV-1 


Agent or common representative; or 
address for correspondence 






The person identified below is 


agent 




hereby/has been appointed to act on 




behalf of the applicant(s) before the 






competent International Authorities as: 




IV-1-1 


Name (LAST, First) 


TRELEVEN, Colin 


IV-1 -2 


Address: 


Motorola European Intellectual 
Property Operations 
Midpoint/ Alencon Link 
Basingstoke, Hampshire rg21 7pl 
United Kingdom 


IV-1 -3 


Telephone No. 


01256 790271' 


IV-1 -4 


Facsimile No. 


01256 811319 



.THIS 



O 



PCT REQUEST 



3/4 



Original (for SUBMISSION) - printed on 19.07.2001 09:59:12 AM 



CM00641P/CT 



V 

V-1 



Designation of States 



Regional Patent 

(other kinds of protection or treatment, 
if any, are specified between 
parentheses after the designation(s) 
concerned) 



AP: GH GM KE LS MW MZ SD SL SZ TZ UG ZW 
and any other State which is a 
Contracting State of the Harare Protocol 
and of the PCT 

EA : AM AZ BY KG KZ MD RU T J TM and any 
other State which is a Contracting State 
of the Eurasian Patent Convention and of 
the PCT 

EP: AT BE CH&LI CY DE DK ES FI PR GB GR 
IE IT LU MC NL PT SE TR and any other 
State which is a Contracting State of 
the European Patent Convention and of 
the PCT 

OA: BF BJ CF CG CI CM GA GN GW ML MR NE 
SN TD TG and any other State which is a 
member State of OAPI and a Contracting 
State of the PCT 



V-2 



National Patent 

(other kinds of protection or treatment, 
if any, are specified between 
parentheses after the designation(s) 
concerned) 



AE AG AL 

CA CH&LI 

FI GB GD 

KE KG KP 

MD MG MK 

SD SE SG 

US UZ VN 



AM AT AU AZ BA BB BG BR 

CN CR CU CZ DE DK DM DZ 

GE GH GM HR HU ID IL IN 

KR KZ LC LK LR LS LT LU 

MN MW MX MZ NO NZ PL PT 

SI SK SL TJ TM TR TT TZ 

YU ZA ZW 



BY BZ 

EE ES 

IS JP 

LV MA 

RO RU 

UA UG 



V-5 



Precautionary Designation Statement 

In addition to the designations made 
under items V-1, V-2 and V-3, the 
applicant also makes under Rule 4.9(b) 
all designations which would be 
permitted under the PCT except any 
designation(s) of the State(s) indicated 
under item V-6 below. The applicant 
declares that those additional 
designations are subject to confirmation 
and that any designation which is not 
confirmed before the expiration of 15 
months from the priority date is to be 
regarded as withdrawn by the applicant 
at the expiration of that time limit. 



V-6 



Exciusion(s) from precautionary 
designations 



NONE 



VI-1 

VI-1-1 
VI-1-2 
VI-1 -3 



Priority claim of earlier national 
application 

Filing date 

Number 
Country 



19 July 2000 (19.07.2000) 

0017660.2 

GB 



VIM 



International Searching Authority 
Chosen 



European Patent Office (EPO) (ISA/EP) 



THIS PAGE BLANK mmo) 



4/4 

PCT REQUEST CM00641P/CT 

Original (for SUBMISSION) - printed on 19.07.2001 09:59:12 AM 



VIII 


Check list 


number of sheets 


electronic file(s) attached 


VIII-1 


Request 


4 




Vtll-2 


Description 


18 




VIII-3 


Claims 


7 




VIII-4 


Abstract 


1 


EZABST00.TXT 


Vltl-5 


Drawings 


7 




Vlll-7 


TOTAL 


37 




Accompanying items 


paper document(s) attached 


electronic fiie(s) attached 


VIII-8 


Fee calculation sheet 






VIII-9 


Separate signed power of attorney 






vm-10 


Copy of general power of attorney 


reference no. 5132 




VIIM2 


Priority document(s) 


Item(s) VI-1 




VW-16 


PCT-EASY diskette 




diskette 


VIIM8 


Figure of the drawings which should 
accompany the abstract 


3 


VIII-19 


Language of filing of the 
international application 


English 


IX-1 


Signature of applicant or agent 




1X1-1 


Name (LAST, First) 


T RE L EVEN, Colin 


FOR RECEIVING OFFICE USE ONLY 


10-1 


Date of actual receipt of the 
purported international application 




10-2 


Drawings: 






10-2-1 


Received 






10-2-2 


Not received 






10-3 


Corrected date of actual receipt due 
to later but timely received papers or 
drawings completing the purported 
international application 




10-4 


Date of timely receipt of the required 
corrections under PCT Article 1 1 (2) 




10-5 


International Searching Authority 


ISA/EP 


10-6 


Transmittal of search copy delayed 
until search fee is paid 




FOR INTERNATIONAL BUREAU USE ONLY 


11-1 


Date of receipt of the record copy by 
the International Bureau 





^ f AGE BLANK 



(USPTfy 



# o 



1/2 

PCT (ANNEX - FEE CALCULATION SHEET) CM00641P/CT 

Original (for SUBMISSION) - printed on 19.07.2001 09:59:12 AM 



(This sheet is not part of and does not count as a sheet of the international application) 



0 

0-1 


For receiving Office use only 

International Application No. 




0-2 


Date stamp of the receiving Office 






0-4 

0-4-1 


Form -PCT/RO/101 (Annex) 
PCT Fee Calculation Sheet 

Prepared using 


PCT-EASY Version 2.91 
(updated 01.01.2001) 


0-9 


Applicant's or agent's file reference 


CM00641P/CT 


2 


Applicant 


MOTOROLA INC, et al . 


12 

12-1 

12-2 
12-3 

12-4 
12-5 
12-6 
12-7 
12-8 

12-9 

12-10 
12-11 
12-12 
12-13 


Calculation of prescribed fees 


fee amount/multiplier 


total amounts (DEM) 




Transmittal fee T 


<=> 


17 5 




Search fee S 


<=> 


1, 848.26 




International fee 
Basic fee 
(first 30 sheets) b1 


799 .93 




Remaining sheets 


7 


Additional amount (X) 


17 .6 


Total additional amount b2 


123 .2 


b1 + b2 = B 


923 .13 


Designation fees 

Number of designations contained 
in international application 


87 


Number of designation fees 
payable (maximum 6) 


6 


Amount of designation fee (X) 


172 .11 


Total rip^innatinn f*»£»<s D) 

i uiai vjcoiyi lauui i ices u 


1, 032 .66 


PCT-EASY fee reduction R 


-200 


Total International fee (B+D-R) 1 


<=> 


1,755 .79 




12-17 


TOTAL FEES PAYABLE (T+S+l+P) 


<=> 


3,779.05 




12-19 


Mode of payment 


other: authorized to charge deposit 
account 


12-20 


Deposit account instructions 

The receiving Office: 


European Patent Office (EPO) (RO/EP) 


12-20- 
2 


is hereby authorized to charge any 
deficiency or credit any over-payment in 
the total fees indicated above to my 
deposit account 


S 


12-20- 
3 


is hereby authorized to charge the fee 
for preparation and transmittal of the 
priority document to the International 
Bureau of WIPO to my deposit account 




12-21 


Deposit account No. 


28050071 


12-22 


Date 


19 July 2001 (19.07.2001) 



THIS PAGE BLANK (osno) 



2/2 



PCT (ANNEX - FEE CALCULATION SHEET) 

Original (for SUBMISSION) - printed on 19.07.2001 09:59:12 AM 



CM00641P/CT 



12-23 



Name and signature 



TRELEVEN, Colin 



VALIDATION LOG AND REMARKS 



THIS PAGE BUNK 



WSPTD) 



(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 

International Bureau 

(43) International Publication Date 
31 January 2002 (31.01.2002) 




PCT 



(HO) International Publication Number 

WO 02/09439 A3 



(51) International Patent Classification 7 : H04N 7/50. 7/30 

(21) International Application Number: PCT/EP0 1/08396 

(22) International Filing Date: 19July 2001 (19.07.2001) 

(25) Filing Language: English 

(26) Publication Language: English 



(30) Priority Data: 

0017660.2 



1 9 July 2000 ( 1 9.07.2000) GB 



(71) Applicant (for all designated States except US): MO- 
TOROLA INC. [US/US]: J 303 E. Algonquin Road. 
Schaumburg, IL 60196 (US). 

(72) Inventors; and 

(75) Inventors/Applicants (for US only): LALLET, Arthur 
[FR/FRJ; Chemin de la Fourciere. F-02260 Gergny (FR). 
HOBSON, Paola, Marcella [GB/GB]; 24 Soper Grove. 
Basingstoke, Hampshire RG21 5PU(GB). MAY, Anthony, 
Richard [GB/GB]; 15 Plough Way. Winchester. Hamp- 
shire S022 4PX (GB). 



(74) Agent: TRELEVEN, Colin: Motorola European Intellec- 
tual, Property Operations, Midpoint, Alencon Link. Bas- 
ingstoke. Hampshire RG2I 7PL (GB). 

(81) Designated States (national): AE, AG. AL. AM, AT, AU, 
AZ, BA. BB. BG, BR. BY. BZ. CA. CH, CN, CR, CU, CZ, 
DE, DK. DM. DZ. EE, ES, Fl. GB. GD, GE, GH. GM. HR, 
HU, ID, IL, IN, IS. JP. KE. KG, KP. KR, KZ, LC. LK, LR, 
LS. LT. LU. LV, MA, MD. MG. MK, MN, MW. MX, MZ, 
NO, NZ. PL. PT, RO. RU, SD, SE. SG. SI. SK. SL. TJ. TM, 
TR. TT, TZ, UA, UG, US. UZ. VN. YU. ZA. ZW. 

(84) Designated States (regional): ARIPO patent (GH. GM, 
KE, LS, MW, MZ. SD, SL. SZ, TZ. UG, ZW). Eurasian 
patent (AM. AZ. BY, KG. KZ, MD, RU, TJ. TM). European 
patent < AT, BE. CH. CY, DE, DK, ES, Fl. FR. GB. GR, IE. 
IT. LU. MC. NL, PT. SE. TR), OAP1 patent (BF. BJ. CF. 
CG. CI. CM. GA. GN, GQ. GW. ML. MR, NE. SN. TD. 
TG). 

Published: 

— with international search report 

[Continued on next page J 



(54) Title: APPARATUS AND METHOD FOR VIDEO CODING AND TRANSMISSION 



107- 



CALCULATED TARGET 
QUANTIZATION 



VIDEO IN 



101 



I 



< 



INTRA/INTER 
SELECTION 



INTRA BLOCKS BUFFER 
CALCULATE SIZE 



OCT AND 
QUANTIZATION 



-106 



ENCODER 



INVERSE OCT/ 
QUANTIZATION 



-EK-I 



FRAME 




MOTION 


BUFFER 




COMPENSATION 



MOTION 
VECTORS 



BITSTREAM 

V 



102 



STANDARD H 263/H 261 
VIDEO ENCODER" 

(57) Abstract: Apparatus and methods for controlling the amount of data used to transmit still images during the transmission of 
a video sequence from a first to a second location are disclosed. The apparatus of one embodiment comprises encoding means 
(105) arranged for intraframe encoding still images for transmission and intraframe encoding part or all of selected video sequence 
frames, calculating means (106) for determining the data size of intraframe encoded video sequence frames and control means (107) 
for controlling intraframe encoding of stil! images for transmission in dependence on the determined intraframe encoded size of a 
previous video sequence frame. The system can be operated in a way so as to remain H.263 compliant. Other embodiments control 
the data size by adjusting the quantization used for each Macroblock and by reprocessing each Group of Blocks until a desired data 
size is reached. 



T «'S PAGE BUNK 



(USFTO) 



WO 02/09439 A3 



mum 


iiiiiiiiiiiiiii 


Mill 


IIIIIIIIIIIIIII 



before I he expiration of the time limit for amending the 
claims and to he republished in the event of receipt of 
amendments 



For tM'o-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Garette. 



(88) Date of publication of the international search report: 

27 June 2002 



IN" ^NATIONAL SEARCH REPORT 



Inten nal Application No 

PCT/EP 01/08396 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC 7 H04N7/B0 H04N7/30 



According to International Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 

IPC 7 H04N 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practical, search terms used) 

EPO-Internal 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category ° Citation of document, with indication, where appropnate, of the relevant passages 



Relevant to claim No. 



RIBAS-CORBERA J ET AL: "RATE CONTROL IN 
DCT VIDEO CODING FOR LOW-DELAY 
COMMUNICATIONS" 

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS 
FOR VIDEO TECHNOLOGY, IEEE INC. NEW YORK, 
US, 

vol. 9, no. 1, February 1999 (1999-02), 
pages 172-185, XP000802296 
ISSN: 1051-8215 
paragraph '00IV! 



EP 0 478 230 A (AMERICAN TELEPHONE & 
TELEGRAPH) 1 April 1992 (1992-04-01) 

column 3, line 42 -column 4, line 16; 
figure 3 



1-3, 

5-10, 

12-14 



4,11, 
15-50 

1-3, 

5-10, 

12-14 

4,11, 

15-50 



-/-- 



Further documents are listed in the continuation of box C. 



Patent family members are listed in annex. 



• Special categories of cited documents : 

*A* document defining the general stale of the art which is not 

considered to be of particular relevance 
"E" earlier document but published on or after the international 

filing date 

*L a document which may throw doubts on priority daim(s) or 
which is cited to establish the publication date of another 
citation or other special reason (as specified) 

'O* document referring to an oral disclosure, use. exhibition or 
other means 

'P 1 document published prior to the international filing date but 
later than the priority date claimed 



"T" later document published after the international filing date 
or priority date and not in conflict with the application but 
cited to understand the principle or theory underlying the 
invention 

'X' document of particular relevance; the claimed invention 
cannot be considered novel or cannot be considered to 
involve an inventive step when the document is taken alone 

a Y* document of particular relevance: the claimed invention 

cannot be considered to involve an inventive step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
in the art. 

document member of the same patent family 



Date of the actual completion of the international search 



24 April 2002 



Date of mailing of the international search report 



06/05/2002 



Name and mailing address of the ISA 

European Patent Office, P.B. 5816 Patentlaan 2 
NL - 2280 HV Rijswijk 
Tel. (+31-70) 340-2040, Tx. 31 651 eponl. 
Fax: (+31-70) 340-3016 



Authorized officer 



Georgiou, G 



Form PCT/1SA/210 (second shoot) (July 1992) 



page 1 of 3 



r 



m * BLANK ius m > 





IN ^NATIONAL SEARCH REPORT 






Inter. nal Application No 






PCT/EP 01/08396 


C.(Contlnuation) DOCUMENTS CONSIDERED TO BE RELEVANT 


Category " 


Citation of document, with indication .where appropriate, of the relevant passages 


Relevant to claim No. 


X 


US 5 872 598 A (WELLS AARON ET AL) 


1-3 




16 February 1999 (1999-02-16) 


5-10 






12-14 


A 


column 4, line 54 -column 5, line 6 


4 11 







15-50 


X 


BO TAO ET AL: "A rate-auantization model 


1-3 




for MPEG encoders" 


5-10, 




IMAGE PROCESSING, 1997. PROCEEDINGS., 


12-14 




INTERNATIONAL CONFERENCE ON SANTA BARBARA, 






CA, USA 26-29 OCT. 1997, LOS ALAMITOS, CA, 






USA, IEEE COMPUT. SOC, US, 






26 October 1997 (1997-10-26), pages 






338-341, XP010254176 






ISBN: 0-8186-8183-7 




A 


paragraph '02.3! 


4,11. 







15-50 


X 


US 5 144 426 A (FUJIKAWA WATARU ET AL) 


15-17, 




1 September 1992 (1992-09-01) 


21, 






23-26, 






30 32 


A 


column 5, line 64 -column 6, line 14 


1-14, 






18-20 






22 






27-29 1 






31 33-50 




column 19, line 10 - line 33 


X 


LEE J-W ET AL: "TARGET BIT MATCHING FOR 


15 16 




MPEG-2 VIDEO RATE CONTROL" 


24,25 




PROCEEDINGS OF IEEE TENCON'98. IEEE REGION 




10 INTERNATIONAL C0NFERENCE0N GLOBAL 






CONNECTIVITY IN ENERGY, COMPUTER, 






COMMUNICATION AND CONTROL. NEW DEHLI, 






INDIA, DEC. 17 - 19, 1998, IEEE REGION 10 


• 




AQ.in.Hiai /"\ /"\ ft 1 C\ ^ ft t m*\ f~ » i r I I % » ■ * n ■ « * m «— m , , A 

ANNUAL CONFERENCE, NEW YORK, NY: IEEE, US, 






vol . 1 OF 2, 






17 December 1998 (1998-12-17), pages 






66-69, XP000878387 






ISBN: 0-7803-4887-7 




A 


paragraph '02.2! 


1-14, 






17-23, 






26-50 


X 


EP 1 005 233 A (ST MICROELECTRONICS SRL) 


33-35, 




31 May 2000 (2000-05-31) 


37-44, 






46-50 


A 


page 11, line 1 - line 42 


1-32,36, 






45 




-/-- 





ISA/210 (continual ton of second sheet) (July 1992) 



page 2 of 3 




n 



IN' ^NATIONAL SEARCH REPORT 



Inter. nal Application No 

PCT/EP 01/08396 



C.(Contlnuatlon) DOCUMENTS CONSIDERED TO BE RELEVANT 



Category • Citation ol document, with indication.where appropriate, ot the relevant passages 



Relevant to claim No. 



TAE-YONG KIM ET AL: "An accurate rate 
control of MPEG video by rate-codewords 
model ing" 

CIRCUITS AND SYSTEMS, 1997. ISCAS '97., 
PROCEEDINGS OF 1997 IEEE INTERNATIONAL 
SYMPOSIUM ON HONG KONG 9-12 JUNE 1997, NEW 
YORK, NY, USA, IEEE, US, 

9 June 1997 (1997-06-09), pages 
1261-1264, XP010236445 
ISBN: 0-7803-3583-X 

paragraph '0004! 



1-50 



Form PCT/1SA/210 (continuation ol second sheet) (July 1992) 



page 3 of 3 



THIS PAGE BUNK 



(USPTO) 



IN^ ^NATIONAL SEARCH REPORT 

Information on patent family members 


Inters lal Application No 

PCT/EP 01/08396 


Patent document 
cited in search report 


Publication 
date 


Patent family 
member(s) 


Publication 
date 



EP 0478230 



01-04-1992 



US 
CA 
DE 
DE 
EP 
JP 
JP 
KR 



5038209 A 
2050102 Al 
69124760 Dl 
69124760 T2 
0478230 A2 
2509770 B2 
4288776 A 
9504118 Bl 



06-08- 
28-03- 
03-04- 

12- 06- 
01-04- 
26-06- 

13- 10- 
25-04- 



1991 
1992 
1997 
1997 
1992 
1996 
1992 
1995 



US 5872598 



16-02-1999 NONE 



US 5144426 A 01-09-1992 



JP 


2026602 


C 


26-02-1996 


JP 


3214989 


A 


20-09-1991 


JP 


7061155 


B 


28-06-1995 


JP 


2629409 


B2 


09-07-1997 


JP 


4051689 


A 


20-02-1992 


JP 


2112450 


C 


21-11-1996 


JP 


3127581 


A 


30-05-1991 


JP 


7061153 


B 


28-06-1995 


JP 


2026592 


C 


26-02-1996 


JP 


3127582 


A 


30-05-1991 


JP 


7061154 


B 


28-06-1995 


us 


RE37091 


El 


13-03-2001 



EP 1005233 A 31-05-2000 EP 1005233 Al 31-05-2000 

JP 2000152237 A 30-05-2000 
US 6215820 Bl 10-04-2001 



Form PCT/1SA/210 (patent family annex) (July 1992) 



D 



(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 

International Bureau 

(43) International Publication Date 
31 January 2002 (31.01.2002) 




PCT 



(10) International Publication Number 

WO 02/09439 A2 



(51) International Patent Classification 7 : H04N 7/26 

(21) International Application Number: PCT/EP0 1/08396 

(22) International Filing Date: 19 July 2001 (19.07.2001) 

(25) Filing Language: English 

(26) Publication Language: English 



(30) Priority Data: 

0017660.2 



19 July 2000 (19.07.2000) GB 



(71) Applicant (for all designated States except US): MO- 
TOROLA INC. | US/US]; 1303 E. Algonquin Road, 
Schaumburg, IL 60196 (US). 

(72) Inventors; and 

(75) Inventors/Applicants (for US only): LA LLET, Arthur 

[FR/FR|; Chcmin de la Fourciere, F-02260 Gcrgny (FR). 
HOBSON, Paola, Marcella [GB/GB|; 24 Soper Grove, 
Basingstoke, Hampshire RG21 5PU (GB). MAY, Anthony, 
Richard [GB/GB]; 15 Plough Way, Winchester, Hamp- 
shire SQ22 4PX (GB). 



(74) Agent: TRELEVEN, Colin; Motorola European Intellec- 
tual, Properly Operations, Midpoint, Alcncon Link, Bas- 
ingstoke, Hampshire RG2I 7PL (GB). 

(81) Designated States (national): AE, AG, AL, AM, AT, AU, 
AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CR, CU, CZ, 
DE, DK, DM, DZ, EE, ES, PI, GB, GD, GE, GI I, GM, MR, 
HIJ, ID, rL, IN, IS, JP, KE, KG, KP, KR, KZ, LC, LK, LR, 
LS, LT, LU, LV, MA, MD, MG, MK, MM, MW, MX, MZ, 
NO, NZ, PL, Fr, RO, RU, SD, SE, SG, SI, SK, SL, TJ, TM, 
TR, TT, TZ, UA, UG, US, UZ, VN, YU, ZA, ZW. 

(84) Designated States (regional): ARIPO patent (GH, GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZW), Eurasian 
patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European 
patent (AT, BE, CI I, CY, DE, DK, ES, FI, FR, GB, GR, m, 
IT, LU, MC, NL, FF, SE, TR), OAPI patent (BF, BJ, CF, 
CG, CI, CM, GA, GN, GQ, GW, ML, MR, NE, SN, TD, 
TO). 

Published: 

— without international search report and to be republished 
upon receipt of that report 

[Continued on next page] 



(54) Title: APPARATUS AND METHOD FOR IMAGE TRANSMISSION 



VIDEO IN 



101 



< 

m 

On 

o 



100—' 



CALCULATED TARGET 
QUANTIZATION 



INTRA BLOCKS BUFFER 
CALCULATE SIZE 



INTRA /INTER 
SELECTION 



7— 

103 



OCT AND 
QUANTIZATION 



INVERSE OCT/ 
QUANTIZATION 



,-106 



ENCODER 



FRAME 




MOTION 


BUFFER 




COMPENSATION 



MOTION 
VECTORS 



105 



BITSTREAM 



102 



STANDARD H_263/H 261 
VIDEO ENCODER" 

(57) Abstract: Apparatus and methods for controlling the amount of data used to transmit still images during the transmission of 
a video sequence from a first to a second location arc disclosed. The apparatus of one embodiment comprises encoding means 
(105) arrange for inlraframe encoding still images for transmission and intraframe encoding part or all of selected video sequence 
frames, calculating means (106) for determining the data size of inlraframe encoded video sequence frames and control means (107) 
for controlling inlraframe encoding of still images for transmission in dependence on the determined inlraframe encoded size of a 
previous video sequence frame. The system can be operated ina way so as to remain 1-1.263 compliant. Other embodiments control 
the data size by adjusting the quantization used for each Macroblock and by reprocessing each Group of Blocks until a desired data 
size is reached. 




For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 





10/ 07020 



WO 02/09439 



MfdPCT/PTO 0 4 MAR 2002 



PCT/EPO 1/08396 



Apparatus and Method for Image Transmission 



Field of the Invention 



10 



15 



20 



25 



30 



The present invention relates to methods and apparatus for controlling the amount of 
data used to transmit still images. 



Many circumstances exist when it is necessary to transmit video sequences, i.e. 
moving picture sequences, from one location to another. Various standards exist 
within which such video transmission is carried out. These standards relate 
particularly to the compression to which the video signal is subjected prior to 
transmission. 

Examples of video compression standards are ITU (International Telecommunications 
Union) H.261 and H.263 and MPEG. The H.263 compression standard is currently 
of particular interest, as it relates to the transmission of video at low bit rates. The 
H.263 compression standard is thus suitable for use in communication over IP 
(Internet Protocol) networks and wireless communications networks. 

Generally, the H.263 standard is designed for transmission over communication 
channels which have lower bandwidths than channels typically used for MPEG 
transmission. However, the H.263 standard is scalable, and can be used to transmit 
information with a range of communication frequencies. Communication using the 
H.263 standard may typically be at frequencies in the range of 1-32 kbits/second. In 
comparison to this, MPEG4 transmits information in a completely different format 
than H.263. MPEG4 is also scalable to different frequencies, but is designed to 
transmit at typically 64 kbits/second. 

In some circumstances a user may wish to transmit a still image using a system 
normally used to transmit video sequences. The still image may be, for example, 
either a freeze frame in a video sequence, or a single frame extracted from a video 
sequence. Where sending of such still images is carried out in accordance with a still 
image standard, such as JPEG, there is a need for additional software and hardware at 
the transmitting and receiving locations. 



Background of the Invention 



CONFIRMATION COPY 




WO 02/09439 




PCT/EP01/08396 



10 



15 



20 



- - 25- 



30 



Further, in any typical transmission system, the amount of bandwidth available and/or 
the time which the user wishes to commit to the transmission of a still image will be 
limited. At the same time, the user will require that any transmitted still image has an 
appropriate quality at the receiving end. The amount of data, or number of bits, used 
to transmit a still image clearly affects the quality at the receiving end. The number of 
bits clearly also affects the amount of time required to transmit the image. 

Quantisation is a process for quantifying the value of a parameter which may take 
values within a range. Quantisation can be seen simply as a process of dividing up 
information into predetermined sub-ranges. Firstly, the whole range of values that a 
parameter may take is divided up into sub-ranges. Any measured value of the 
parameter must fall into one of these sub-ranges. For the value that the parameter takes 
at any particular instant, it is only necessary to decide which one of these sub-ranges 
the value falls in to. Thus quantistion is analogous to classifying data into 'bins'. 

Once the values of a parameter have been quantised, then a transmitter can transmit to 
a receiver information about which sub-range the parameter fell into at each point in 
time. This transmission enables the transmitter to send a reduced quantity of data, 
compared to what would be required if transmitting each exact value that the 
parameter took. The transmitter can therefore use a transmission channel of lower 
bandwidth. The receiver however has a less precise knowledge of the value of the 
parameter, since the receiver only knows which sub-range the parameter fell into, 
rather than the exact value which the parameter took. 

If the 'quantisation' is increasedr^ means that 

the classification of successive values of the parameter is effectively 'coarser'. As a 
result, even less data need be transmitted. However, a receiver receives a 
correspondingly grainier or coarser measurement of the value which the parameter 
took. So an image with high quantisation will require the transmission of less data 
than an image of low quantisation, because the data has been compressed more, but 
the received image will be of lower quality. 

It is an object of the invention to provide systems which are suitable for controlling the 
amount of data used to transmit a still image during the transmission of video 
sequences, whilst remaining compliant with the transmission standard used when 
transmitting the video sequence. 
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Prior art video coding techniques are known from published patent applications EP-A- 
574244 and WO-A-9424823. Other prior art video coding techniques are known from 
published United States patents US-A-5978544 and US-A-5692074. 



According to one aspect of the present invention, there is provided apparatus for 
controlling the amount of data used to transmit still images during or after the 
transmission of a video sequence from a first location to a second location, as claimed 
in claim 1 . 

According to a second aspect of the present invention, there is provided a method for 
controlling the amount of data used to transmit still images during or after the 
transmission of a video sequence from a first to a second location, as claimed in claim 8. 

According to a third aspect of the present invention, there is provided apparatus for 
controlling the amount of data used to transmit still images, as claimed in claim 15. 

According to a fourth aspect of the present invention, there is provided a method for 
controlling the amount of data used to transmit still images, as claimed in claim 24. 

According to a fifth aspect of the present invention, there is provided apparatus for 
controlling the amount of data used to transmit still images, as claimed in claim 33. 

According to a sixth aspect of the present invention, there is provided a method for 
controlling the amount of data used to transmit still images, as claimed in claim 42. 

Each of the above aspects of the invention enables the size of data files used to 
transmit still images during the transmission of a video sequence to be controlled, with 
the aim of achieving a desired file size. The above aspects of the invention can be 
used in such a way as to remain compliant with the standard used for the transmission 
of the video sequence. 

In some embodiments it is also possible to control the size of files used to transmit still 
images where there has been no preceding video sequence. 

Further aspects of the invention are as claimed in the dependant claims. Additional 
specific advantages are apparent from the following description and figures. 
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Brief Description of the Drawings 

Figure 1 shows the arrangement of Macroblocks and Groups of Blocks in a QCIF 
picture; 

5 

Figure 2 shows schematically the quantization process used in a typical video 
compression system; 

Figure 3 shows apparatus for encoding video signals for transmission, and for 
1 0 controlling the size of data files used to transmit still images in accordance with a first 
embodiment; 



15 



Figure 4 is a flow chart showing the method used for controlling the size of data files 
used to transmit still images in accordance with the first embodiment; 

Figure 5 shows apparatus for encoding video signals for transmission and for 
controlling the size of data files used to transmit still images in accordance with a 
second embodiment; 

20 Figure 6 is a flow chart showing the method used for controlling the size of data files 
used to transmit still images in accordance with the second embodiment; 

Figure 7 shows apparatus for encoding video signals for transmission and for 
controlling the size of data files used to transmit still images in accordance with a third 
• -25 embodiment; and 

Figure 8 is a flow chart showing the method used for controlling the size of data files 
used to transmit still images hi accordance with the third embodiment. 

30 Description of Embodiments of the Invention 

Video compression techniques such as those used within the H.263 and H.261 
standards are well known to those skilled in the art, and a detailed description of such 
techniques is not necessary in the present application. However, an overview of the 
35 process applicable to the H.263 standard is given below to aid in the understanding of 
the present invention. 
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In the encoding process, each input video frame is considered to consist of a plurality 
of blocks, each of which is 16 x 16 pixels in size and is termed a Macroblock. Each 
of these Macroblocks is composed of 8 x 8 pixel blocks which are subjected to a 
discrete cosine transform (DCT) operation. The resulting coefficients are quantized to 
5 reduce the amount of data before it is introduced into the bitstream. 

The compression technique works in two ways. First, the DCT and quantization 
operations aim to isolate the most important data relating to the Macroblock 
concerned, and to exclude the redundant data. Further compression is obtained 

1 0 because, rather than sending complete details of each frame of the video sequence, a 
large number of frames are simply represented by data which indicates the changes 
between the present frame and the previous frame. Frames that are processed without 
reference to any earlier frame are said to be intraframe encoded frames. However, 
frames that are processed and transmitted by way of indicating the changes between 

1 5 that frame and a previous frame are said to be inter frame encoded. When an 

inter frame encoded frame is received at a receiver, then the image to be displayed is 
regenerated by the receiver using the information concerning the changes in the image, 
to appropriately modify the previously decoded frame. 

20 Figure 1 shows the arrangement of Macroblocks (MBs) 1 in a QCIF (Quarter 

Common Intermediate Format - 176 pixels x 144 lines) picture. A QCIF picture is 
divided into nine Groups of Blocks (GOBs) 2, each of which comprises eleven 
Macroblocks 1 arranged horizontally across the picture. Note that in Figure 1 some of 
the Macroblocks are not shown, to simplify the figures and thereby ease 

25 understanding. In the bitstream, headers are provided for each Macroblock 1, each 
Group of Blocks 2 and each frame as a whole. 

In the embodiments of the invention, as described in more detail below, controlling of 
a quantization factor used in quantization of the DCT coefficients for each Macroblock 
30 is used to control the overall data size of encoded still images. 

Figure 2 shows schematically the quantization process carried out on the DCT 
coefficients calculated for a single block within a Macroblock 1. Matrix Tl shows an 
exemplary set of DCT coefficients for a single block. The level of quantization 
35 carried out on each Macroblock can be adjusted by means of a quantization parameter 
"QUANT". The quantisation parameter can be associated with a single Macroblock, 
the whole image or any sub-combination of Macroblocks. Matrix T2 shows the 
quantized DCT coefficients which are calculated by dividing the DCT coefficients for 
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the block Tl by the calculated quantization value, 2*QUANT, and truncating the 
results to integer. In this example, QUANT =5. 

This process of quantization typically leads to a large number of zero entries in the 
5 quantized DCT coefficient table T2, because all results of dividing Tl by 2*QUANT 
which are below 1 are set to zero. 

When the quantized DCT coefficients in T2 are encoded for transmission, the 
coefficients are ordered in the bitstream in a preselected order and the bitstream for 
1 0 that particular block is truncated after the last non-zero quantized coefficient. 

In order that the signal can be dequantized at the receiving end, the quantization 
parameter QUANT used for each Macroblock is also transmitted in the bitstream. 

15 In H.263, there are three ways in which the quantization parameter QUANT can be 
communicated to the receiving end. First of all, in the header for the whole frame, a 
quantization parameter PQUANT is included. PQUANT is used for all of the 
Macroblocks in that frame unless other instructions are issued. Secondly, a 
quantization parameter GQUANT is included in the header for each Group of Blocks. 

20 The value of GQUANT will be used for quantization of each of the Macroblocks* in 

the respective Group of Blocks in preference to PQUANT unless other instructions are 
received. A third level of flexibility is provided by a quantization parameter 
DQUANT. DQUANT is included in the header for each Macroblock, and serves to 
determine the quantization to be used for that specific Macroblock. 
-25 . _ _ . 

In practice, the values of PQUANT and GQUANT are absolute values, whereas 
DQUANT is used to increment or decrement the current value of PQUANT or 
GQUANT as appropriate. 

30 As is well known to those in the art, and can be seen from Figure 2 and the above 
description, changing the value of the quantization factor Q by altering the 
quantization parameters PQUANT, GQUANT and DQUANT can significantly change 
the size of data file used to transmit images. This change in size will significantly 
affect the quality of a transmitted still image, and the time required to transmit the still 

35 image. 



WO 02/09439 




In each of the embodiments described below, the apparatus is suitable for transmitting 
a video sequence in accordance with the H.263 standard. This is carried out in a 
standard way and no detailed consideration of that process is given below. 

5 In operation of the present embodiments, a video sequence encoded in accordance with 
H.263 may be being sent from a camera to a remote display. At some point during 
the video transmission, a user will indicate to the system that a high quality still image 
is required. The user may be at either the camera or the display end. This indication 
may be made by pressing an appropriate button or any other suitable means. Once 
10 such an indication has been made, the encoder at the transmission end will modify its 
operation and generate an encoded still image to be inserted into the bitstream for 
transmission. 

It is this modified operation, and in particular the control of the size of data file used 
15 to transmit the still image, which is of particular importance in the present invention. 
This modified operation is described separately below in respect of three 
embodiments. 

First Embodiment of the Invention 

20 

Figure 3 shows apparatus for encoding video signals for transmission and for 
controlling the size of data files used to transmit still images in accordance with a first 
embodiment of the present invention. In this embodiment it is assumed that video 
sequences are to be transmitted within the H.263 standard. The apparatus comprises a 
25 standard H.263/H.261 video encoder 100, which is arranged to receive a video signal 
at an input 101 and output an encoded bitstream at an output 102. 

Since the structure and operation of a standard H.263/H.261 video encoder 100 are 
well known to those skilled in the art, no detailed description is given in this 
30 application. However, to aid in understanding of the present invention, it is noted that 
the standard video encoder 100 includes means for selecting between intraframe and 
interframe encoding 103, means for performing a DCT and quantization operations 
104, and an encoder 105 for encoding the resulting coefficients of the DCT and 
quantization operations into a suitable form to be output into the bitstream. 

35 

In normal operation, the standard video encoder 100 receives video signals at the input 
101, performs operations to determine whether each frame should be intraframe or 
interframe encoded, performs the necessary DCT and quantization operations on each 
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of the Macroblocks in the image and then encodes these for output into the bitstream. 
In normal operation, some frames of a video sequence will be interframe encoded and 
other frames will be intraframe encoded. 

In the present embodiment, in addition to the standard video encoder 100, an encoder 
control unit 106 and a quantization calculation and control unit 107 are provided. The 
encoder control unit 106 is connected to the encoder 105 of the standard video encoder 
100 and to the quantization calculation and control unit 107. The quantization 
calculation and control unit 107 is also connected to the DCT and quantization means 
104 of the standard video encoder 100. 

In the present embodiment, the video encoder 100 performs its normal operation in 
respect of each video sequence frame, generating mainly interframe Macroblocks for 
introduction into the bitstream. However, the encoder control unit 106 also causes 
video encoder 100 to intraframe encode selected Macroblocks in each frame, using a 
preselected PQUANT value. 

These intraframe coded Macroblocks are not put into the bitstream, but rather are fed 
to the encoder control unit 106. Here they are used to calculate the size of data file 
which would have to be sent if the current video sequence frame were to be sent as an 
intraframe encoded still image. This calculated size is output from the encoder control 
unit 106 to the quantization control and calculation unit 107. At the same time, the 
intraframe encoded blocks supplied to the encoder controller unit 106 are stored in a 
buffer for possible later use if, for example, they are requested by a receiving unit 
which-has lost synchronisation. 

On the basis of the calculated size of the hypothetical still image frame, the 
quantization calculation and control unit 107 selects a value for PQUANT which 
should be used if a still frame is requested by a user following that video sequence 
frame. This process is repeated for each video sequence frame so that the quantization 
calculation and control unit 107 always retains a value for PQUANT which has been 
selected on the basis of the last video sequence frame to be sent. 

If and when a still frame is requested by a user, the quantization calculation and 
control unit 107 supplies the calculated value for PQUANT to the DCT and 
quantization means 104 of the video encoder 100. The encoder controller unit 106 
sends an instruction to the encoder 105 that the next frame is to be sent as an 
intraframe encoded still image. 
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The process followed in order to determine the value of PQUANT to be used for a 
requested still image is described in greater detail below with reference to the flow 
chart shown in Figure 4. 

5 

The process illustrated in Figure 4 is carried out in respect of each video sequence 
frame. A variable "target_quantization" is a variable parameter which will be used 
for PQUANT in encoding any subsequent frame. Thus the process in Figure 4 is 
aimed at finding the correct value for target_quantization. When processing the first 
10 frame, target_quantization is set to a default value. In subsequent frames, the previous 
value of targetquantization is used as a starting point. 

In step 1001, at the start of the processing of each frame, a Macroblock counter 
(MBn) is set to zero. 

15 

At step 1002 it is determined whether all of the Macroblocks in the frame have been 
processed, by determining whether the value in the Macroblock counter is smaller than 
the value of the final Macroblock. Whilst the value of the Macroblock counter remains 
smaller than the value for the last Macroblock, the process continues. 

20 

At step 1003, it is determined whether the Macroblock counter shows a value which is 
a multiple of 3 . If it is determined that the Macroblock counter has a value which is a 
multiple of 3, then the corresponding Macroblock is processed to generate an 
intraframe encoded block, using the current target_quantization, and the data size 
25 (size) of the encoded Macroblock is calculated at step 1004. At step 1005, the total 
number of bits (sum_of_bits) used for the Macroblocks encoded so far is calculated. 

On the other hand, when at step 1003 it is determined that the Macroblock counter is 
not a multiple of 3, then steps 1004 and 1005 are skipped. This has the effect that in 
30 each frame, only every third Macroblock is encoded in the process for determining the 
size of the respective hypothetical still image. 

At step 1006, following step 1005 or 1003 as appropriate, each Macroblock is encoded 
as part of the video sequence and put into the bitstream. This encoding is quite 
35 separate from the intraframe encoding carried out in step 1004 and is rather the 

encoding which would take place if the standard video encoder 100 were operating in 
its usual fashion. Therefore the encoding process at step 1006 will normally consist of 
inter frame encoding. 
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At step 1007, the Macroblock counter is incremented by one so that steps 1002 to 
1006 are repeated for the next Macroblock. Once the final Macroblock in the frame 
has been subjected to steps 1003 to 1006, the inequality tested at step 1002 will no 
5 longer be true and the process passes to step 1008. 

At step 1008 it is determined whether sum_of_bits, as calculated in step 1005, is 
smaller than a target value. If it is determined, at step 1008, that sum_of_bits is 
smaller than the target value, this indicates that the target_quantization value used 
1 0 would be expected to generate a still image which would have a too small data size. 
Such a still image would not provide the maximum quality allowed by the data 
size/ transmission time available for sending a still image. Therefore at step 1009 
target_quantization is decreased in such a case. 

15 However, if it is determined at step 1008 that sum_of_bits is not smaller than the 
target, then this indicates that target_quantization as presently set would generate a 
data file which is too large. Correspondingly, at step 1010, target_quantization is 
increased. 

20 If sum_of_bi ts is equal to the target value, then target_quantization is left unchanged. 
This decision step has been omitted from figure 4 for clarity of illustration. 

The modified target_quantization as determined in step 1009 or 1010 becomes the 
value of PQUANT which is stored in the quantization calculation and control unit 107. 
-25 -T-his-is the value of PQUANT-which will be used in encoding a still'frame, "shouia a 
request for such a still frame be made. 

Whilst only every third Macroblock is encoded in step 1004 in the above embodiment, 
this is merely exemplary. A different number of Macroblocks may be encoded per 

30 image. For example, it is possible to encode every Macroblock in each image or only 
every fourth or fifth Macroblock. There is a trade off between processor usage and 
the accuracy of the determined encoded picture size which must be considered when 
choosing how frequently to encode Macroblocks. The more Macroblocks are encoded 
per image, the greater the accuracy of the determined encoded picture size, but the 

35 greater the processor usage. 

The above embodiment has advantages since it allows the real time transmission of 
still images, it is relatively straightforward to generate intraframe coded Macroblocks 



10 



O * £ 

WO 02/09439 ^ ^ PCT/EP01/08396 

for each frame, and the calculations required are simple. Further, the additionally 
generated intraframe Macroblocks can be stored and may be useful for other purposes, 
for example they may be provided to late joiners to a group video call. 

5 In the above embodiment, an attempt is made to determine the encoded size of a 

requested still image by relying on calculations made in respect of the previous video 
sequence frame. Therefore the method will not work if there is no preceding image 
frame and the effectiveness of the method is governed by how much the images change 
from one frame to the next. If the frame rate is low and the scene is moving, or scene 
1 0 cuts occur, then the encoded size of a still image may be significantly greater or much 
smaller than expected from this predictive technique. 

Although in the first embodiment a calculation is made of the size of a hypothetical 
still image in respect of each video sequence frame, it is possible to perform this 
1 5 calculating function less often. As an example, the size of a hypothetical still frame 
may be calculated for only every other video sequence frame. 

Second Embodiment of the Invention 

20 Figure 5 shows apparatus for encoding video signals for transmission and for 

controlling the size of data files used to transmit still images, in accordance with a 
second embodiment of the invention. 

The apparatus shown in Figure 5 is similar to that used in the first embodiment shown 
25 in Figure 3. The apparatus of Figure 5 comprises a standard H.263/H.261 video 
encoder 200, a video signal input 201, an output 202, an intraframe encoding and 
interframe encoding selection means 203, a DCT and quantization processing means 
204 and an encoder 205. The above mentioned components correspond to those in the 
first embodiment having the same reference numerals, except being preceded by a 1 
30 rather than a 2. The standard video encoder 200 operates in substantially the same way 
as the standard video encoder 100. 

In the second embodiment however, the apparatus and method used for controlling the 
data size of intraframe encoded still images are different from those in the first 
35 embodiment. In the second embodiment, rather than the same quantization factor 

being used for the whole of each frame, the quantization factor for each Macroblock 
may be different. This is achieved by making use of the quantization parameter 
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DQUANT which is defined within the H.263 standard, rather than relying on the 
PQUANT parameter used in the first embodiment. 

Further, in the second embodiment, rather than continually carrying out processing of 
5 the video data to calculate an appropriate quantization for a large number of 

hypothetical still images, calculations are only made when a still image is actually to 
be sent. In many cases a still image will only be requested rarely, so this difference 
can reduce significantly the number of calculations which need to be carried out. 

1 0 The apparatus of the second embodiment comprises a Macroblock size calculation unit 
206 and a quantization calculation and control unit 207. The Macroblock size 
calculation unit 206 is connected to the encoder 205 of the standard video encoder 200 
and to the quantization calculation and control unit 207. In turn, the quantization 
calculation and control unit 207 is connected to the DCT and quantization processing 

1 5 means 204 of the standard video encoder 200. 

In the second embodiment, when a user makes a request to initiate the transmission of 
a still image, the quantization calculation and control means 207 causes the DCT and 
quantization processing means 204 and encoder 205 to begin generation of an 

20 intraframe encoded frame. The value of PQUANT used in the last video sequence 

frame to be encoded is used for quantization of the first Macroblock in the still frame. 
Thereafter, the quantization factor used for each Macroblock is adjusted as required by 
the quantization calculation and control unit 207. Details of the quantization used for 
each Macroblock are put into the bitstream by making use of the quantization 

-25— parameter-DQUANT. - 

The process for controlling the size of an encoded still image is explained in more 
detail below, with particular reference to the flow chart shown in Figure 6. 

30 The process shown in the flow chart of Figure 6 is carried out in respect of each still 
image which is requested. A Macroblock counter (MBn) is first set to zero, and in 
step 2001 it is determined whether the Macroblock to be processed is the final one in 
the frame. Until the final Macroblock is reached the following steps are executed. 

35 At step 2002, the Macroblock is operated on to generate the intraframe encoded 
Macroblock, a current value of target_quantization being used in the quantization 
process. For the first Macroblock in each still image this target_quantization equates 
to PQUANT from the previous video sequence frame. For all subsequent 
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Macroblocks, the target_quantization equates to a newly calculated value of 
target_quantization determined in the way described below. 

At step 2003, the value of DQUANT to be included in the Macroblock header is 
5 calculated, based on a subtraction of the target_quantization used for the previous 
Macroblock from the current target_quantization. 

At step 2004 the data size (size) of the encoded Macroblock is calculated. At step 
- 2005, the size of the current Macroblock is added to a sum of all the previously 
1 0 encoded Macroblocks within that frame (sum_of_bits) . 

At step 2006 the average size of all of the Macroblocks so far encoded in the still 
frame is calculated. In the calculation of this average it is noted that the value of 
MBn+ 1 is used since the value of MBn for the first Macroblock is zero. 



At step 2007 the average calculated in step 2006 is compared with a target value which 
corresponds to the desired size of the still image. If the average is smaller than the 
target value, then target_quantization is decreased at step 2008. If the average is 
greater than the target then, at step 2009 target_quantization is increased. 



If the average is equal to the target value then targetquantization is unchanged. This 
step is not shown in Figure 6 for simplicity of illustration. 

At step 2010 the current Macroblock is put into the bitstream and at step 201 1 the 
25 Macroblock counter is increased by one so that the process is repeated for the next 
Macroblock in the frame. 

The method of figure 6 involves calculating the average number of bits per 
macroblock, after encoding each macroblock, and comparing this average with the 
30 target size of data for transmission. The result of this comparison indicates whether 

the quantisation needs to be increased or decreased, and the quantisation is adjusted by 
setting DQUANT. 

In the second embodiment of the invention, undesirable visual affects can occur if the 
35 quantization between adjacent Macroblocks is changed too abruptly. Therefore, it has 
been found preferable to set a maximum allowed change in target_quantization, in 
steps 2008 and 2009, at two per Macroblock. The value of any such limit may be 
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chosen empirically, so as to reduce the undesirable effects on the image to an 
acceptable level. 

In an alternative, rather than allowing a change in target_quantization for each 
5 Macroblock, the quantization calculation and control means 207 may be arranged to 
keep the quantization constant for a preselected number of consecutive Macroblocks 
between each change. 

The second embodiment has advantages because it is simple to implement, and 
10 because the number of calculations is limited, since these are only performed during 
the encoding of a still image. However, there is a limit to the efficiency of the 
system, because large numbers of bits may be assigned to plain areas of the image, 
leaving few for detailed areas. 

15 Third Embodiment of the Invention 

Figure 7 shows an apparatus for encoding video signals for transmission and for 
controlling the size of data files used to transmit still images in accordance with a third 
embodiment of the present invention. 



The apparatus of the third embodiment is similar to that of the first and second 
embodiments. The apparatus of the third embodiment comprises a standard 
H.263/H.261 video encoder 300 having a video input 301, an output 302, intraframe 
and interframe selection means 303, DCT and quantization processing means 304, and 

-25 an encoder- 305.- -The-above-mentioned-components-andtheiroperation-correspond-to 

those in the first and second embodiments having the same reference numerals except 
being preceded by 3 rather than 1 or 2. 



Similarly to the second embodiment, in the third embodiment, the processing used to 
30 control the size of intraframe encoded still image frames is only carried out when 
actually encoding such still images. In the third embodiment, rather than using the 
same quantization for the whole of the still image as in the first embodiment, or 
allowing the quantization used for each Macroblock to change as in the second 
embodiment, a quantization factor is assigned to each Group of Blocks. This 
35 quantization factor is used for all Macroblocks within that GOB, by making use of the 
quantization parameter GQUANT included in the Group of Blocks header. 
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The apparatus of the third embodiment comprises a Group of Blocks size calculation 
unit 306 and a quantization calculation and control unit 307. The Group of Blocks 
size calculation unit 306 is connected to an output of the encoder 305 of the standard 
video encoder 300, and is connected to the quantization calculation and control unit 
5 307. In turn the quantization calculation and control unit 307 is connected to the DCT 
and quantization processing means 304 of the standard video encoder 300. 

In the third embodiment, a proportion of the desired data size for the whole image is 
apportioned to each Group of Blocks in proportion with its physical size. Thus in the 
1 0 case of a QCIF picture of the type shown in Figure 2, a ninth of the total desired data 
size is assigned to each of the Group of Blocks. Each Group of Blocks is then 
encoded using an initial trial quantization and it is determined whether the total 
number of bits used to encode this Group of Blocks falls within a target range. 

15 If the number of bits, i.e. the data size of that Group of Blocks, falls within the 

desired target range then the Group of Blocks is encoded and put into the bitstream. 
On the other hand, if the data size falls outside the target range, then that Group of 
Blocks is re-encoded using a different quantization, and its size is again tested. This 
process is repeated until the size for the Group of Blocks falls within the desired range 

20 or until some time period expires, the time period being selected to be consistent with 
the user's preference for image communication delay. Once the correct quantization 
for a Group of Blocks has been determined, this is included in the bitstream. The 
quantization is included in the bitstream by using PQUANT for the first Group of 
Blocks, and by using GQUANT for the remaining Groups of Blocks in the still image. 

25 PQUANT is used for the first Group of Blocks because, as defined in the H.263 
standard, the first Group of Blocks header in each frame cannot be transmitted. 

The process used to control the data size of each Group of Blocks, and hence the 
whole encoded frame, is described in more detail below with reference to Figure 8. 

30 

In step 3001 a Macroblock counter (MBn) is set to zero at the start of processing a still 
frame to be transmitted. At step 3002 it is determined whether the row number of the 
Macroblock (row_of_MB) to be processed is smaller or equal to the final row. If this 
is not the case, then processing of the still image is complete, and the process stops. 
35 If the row number of the Macroblock is smaller or equal to the final row, then the 
following steps are executed. 
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At step 3003 it is determined whether the total number of bits for the Group of Blocks 



preselected tolerance, a suitable value for which can be determined by carrying out 
experiments. A typical tolerance is +1-5% of the target size. When the total number 
5 of bits falls within the target range then processing of that Group of Blocks is 

complete and the Group of Blocks is encoded and put into the bitstream in step 3004. 
If, on the other hand, at step 3003 it is determined that Total_of_bits falls outside the 
target range then the following steps are executed. 

10 At step 3005 a 'number_of_bits' variable is set to zero, 'Total_of_bits' is set to zero 
and the Macroblock counter is set to (row_of_MB * 11). 

At step 3006, it is determined whether the Macroblock counter is smaller than or equal 
to (row_of_MB + 1) * 11. This inequality is true for each Macroblock in a respective 
1 5 Group of Blocks and step 3006 therefore ensures that the following steps are carried 
out in respect of each Macroblock of the respective Group of Macroblocks before the 
inequality fails to hold. 

In step 3007 an intraframe encoded Macroblock is generated for the present 
20 Macroblock using the current target_quantization and the data size (number_of_bits) of 
the encoded Macroblock calculated. Further, the data size of this Macroblock is added 
to a total size (Total_of_bits) of all the Macroblocks in that Group of Blocks which 
had already been encoded. At step 3008 the Macroblock counter is incremented by 
one so that the above processes are repeated for the next Macroblock. 

When at step 3006 it is determined that the last Macroblock in a respective Group of 
Blocks has been processed, Total_of_bits as calculated at step 3007 is compared with a 
target at step 3009. If at step 3009 it is determined that Total_ofbits is smaller than 
the target, then at step 3010 target_quantization is decreased, whereas if it is 
30 determined that Total_of_bits is not smaller than the target, then target_quantization is 
increased at 3011. If Total_of_bits is equal to the target, then target_quantization is 
unchanged. This latter condition is not shown in Figure 8, for simplicity of 
illustration. 

35 The procedure then runs through steps 3005 to 3011 as appropriate until it is 

determined, at step 3003, that Total_of_bits falls within the target range (target +/- T) 
or some time period expires according to the user's preference for image 
communication delay. 



(Total_of_bits) falls outside the target range (target +/- T). In this expression, T is a 
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Once the correct quantization has been found for that Group of Blocks, the 
Macroblocks are encoded and introduced into the bitstream together with the 
appropriate value of GQUANT, at step 3004 as mentioned above. The process then 
5 repeats steps 3003 to 3011 for the next Group of Blocks until the whole frame has 
been encoded. 

It has been found that the use of the third embodiment gives rise to good image 
quality. Furthermore, the data size for the whole image, and hence the desired 
10 transmission time, can be accurately targeted, because each Group of Blocks may be 
re-encoded until it falls within a target range. However, there is a trade off with this 
method since its implementation is complex and there are significant demands placed 
on processing power. 

15 It will be clear from the above description that the standard video encoder 300 must 
allow Macroblocks to be encoded row by row, i.e. Group of Macroblocks by Group 
of Macroblocks . 



Each of the above embodiments gives advantages because they allow still images to be 
20 sent, whilst remaining compliant with a video compression standard. This means that 
the existing hardware/software of the video sequence encoder can be used. Thus there 
are significant advantages over systems which use a different standard for the 
transmission of still images, such as JPEG, because in such a case there would be a 
requirement for additional hardware and/or software. 

25 

Each of the above embodiments may be improved with regard to the allocation of bits 
to areas of the image which are more important. That is to say, the embodiments may 
be modified so that an area in each image can be designated as a "region of interest", 
in which a lower quantization factor is used to retain more image information. Whilst 
30 it is possible to use regions of interest with each of the embodiments, it is significantly 
more straightforward to implement this with the second and third embodiments. 

The order in which Macroblocks are encoded can be modified and this can assist 
where regions of interest have been designated. 

35 

In a modified form of the second embodiment, Macroblocks in a region of interest 
may first be encoded using quantization factors chosen to give a high quality image. 
This may use a large amount of the available data size for the complete still image. 
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The remainder of the image may then be encoded using quantization factors for each 
Macroblock that are chosen to ensure that the overall data size of the encoded image 
approaches the desired target. 

5 In a modified form of the third embodiment it would be a simple matter to assign a 
larger proportion of the available data size to one or more of the Groups of 
Macroblocks. On the other hand, assigning more of the available data size to 
individual Macroblocks within a Group of Blocks might be more difficult, but it is 
also possible. Again, in such a case it would be possible to first encode Macroblocks 
10 in each Group of Blocks which were within the region of interest, to give the desired 
quality, and then encode the remainder of the Macroblocks in each Group of 
Macroblocks. The remainder of the Macroblocks in each Group of Macroblocks 
would be encoded with a quantization chosen such that the overall data size of the 
respective Group of Blocks fell within the desired target range. 
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Claims 

1 . Apparatus for controlling the amount of data used to transmit still images during or 
after the transmission of a video sequence from a first to a second location, the 
apparatus comprising: 

5 encoding means arranged for intraframe encoding still images for transmission and 
intraframe encoding part or all of selected video sequence frames; 
calculating means for determining the data size of intraframe encoded video sequence 
frames; and 

control means for controlling intraframe encoding of still images for transmission in 
1 0 dependence on the determined intraframe encoded size of a previous video sequence 
frame. 

2. Apparatus according to claim 1, in which the encoding means is arranged to 
intraframe encode part or all of each video sequence frame and the control means is 

1 5 arranged to control intraframe encoding of a still image in dependence on the 
determined size of the most recently intraframe encoded video sequence frame. 

3 . Apparatus according to claim 1 or claim 2 in which the control means is arranged to 
select a quantization factor for use in encoding of a still image in dependence on the 

20 determined intraframe encoded size of a previous video sequence frame. 

4. Apparatus according to claim 1 or claim 2 in which the control means is arranged to 
select, in dependence on the determined intraframe encoded size of a previous video 
sequence frame, a first quantization factor for use in encoding a first part of a still 

25 image and a second quantization factor for use in encoding a second part of a still 
image. 

5. Apparatus according to any preceding claim in which the encoding means is 
arranged to carry out an encoding process in which an image is considered to comprise 

30 a plurality of blocks, each of which is intraframe encoded. 

6. Apparatus according to any preceding claim in which the control means is arranged 
to control intraframe encoding of still images with the aim of keeping the data size of 
the encoded image within predetermined limits. 

35 

7. Apparatus according to any preceding claim in which the encoding and transmission 
of the still images is compatible with the scheme used for encoding and transmitting of 
the video sequence. 
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8. A method for controlling the amount of data used to transmit still images during or 
after the transmission of a video sequence from a first to a second location, the method 
comprising the steps of: 

intraframe encoding part or all of selected video sequence frames; 
5 determining the data size of intraframe encoded video sequence frames; and 

when sending a still image, controlling intraframe encoding of said image in dependence 
on the determined intraframe encoded size of a previous video sequence frame. 

9. A method according to claim 8, comprising the steps of intraframe encoding part or 
1 0 all of each video sequence frame and controlling intraframe encoding of a still image 

in dependence on the determined size of the most recently intraframe encoded video 
sequence frame. 

10. A method according to claim 8 or claim 9, comprising the step of selecting a 

1 5 quantization factor for use in encoding a still image in dependence on the determined 
intraframe encoded size of a previous video sequence frame. 

11. A method according to claim 8 or claim 9 comprising the step of selecting, in 
dependence on the determined intraframe encoded size of a previous video sequence 

20 frame, a first quantization factor for use in encoding a first part of a still image and a 
second quantization factor for use in encoding a second part of a still image. 

12. A method according to any one of claims 8 to 11 in which the encoding process is 
one in which an image is considered to comprise a plurality of blocks each of which is 

25 intraframe Wedded . 

13. A method according to any one of claims 8 to 12 in which the intraframe encoding 
of still images is conducted with the aim of keeping the data size of the encoded image 
within predetermined limits. 



14. A method according to any one of claims 8 to 13 in which the encoding and 
transmission of the still images is compatible with the scheme used for encoding and 
transmitting of the video sequence. 

35 15. Apparatus for controlling the amount of data used to transmit still images, the 
apparatus being suitable for use during the transmission of a video sequence from a 
first to a second location and comprising: 
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encoding means arranged for intraframe encoding still images for transmission, the 
encoding process being one in which a still image is considered to comprise a plurality 
of blocks each of which is intraframe encoded; 

calculating means for determining the data size of intraframe encoded blocks; and 
5 control means for controlling encoding of selected blocks in dependence on the 
determined data size of one or more previously encoded block. 

16. Apparatus according to claim 15 in which the control means is arranged to select a 
quantization factor for use in encoding of a selected block in dependence on the 

1 0 determined size of one or more previously encoded block. 

17. Apparatus according to claim 15 or claim 16 in which the control means is 
arranged to select a quantization factor for use in encoding of a selected block by 
incrementing or decrementing a quantization factor used for a previously encoded 

1 5 block. 

18. Apparatus according to claim 17 in which the control means comprises means for 
calculating the average data size of previously encoded blocks within the respective 
image, the control means being arranged to select the quantization factor for use in 

20 encoding of a selected block by incrementing a quantization factor used for a previously 
encoded block where the average data size falls on one side of a target range or value 
and by decrementing a quantization factor used for a previously encoded block where 
the average data size falls on an opposite side of the target range or value. 

25 19. Apparatus according to claim 17 or claim 18 in which a maximum limit to the 
change in quantization factor caused by each incrementation or decrementation is 
chosen to limit undesirable visual effects in decoded images. 

20. Apparatus according to any one of claims 17, 18 and 19 in which the quantization 
30 factor is kept constant for a selected number of consecutive blocks, the selected 

number being chosen to limit undesirable visual effects in decoded images. 

21. Apparatus according to any one of claims 15 to 20 in which the control means is 
arranged to control intraframe encoding of still images with the aim of keeping the 

35 data size of the encoded image within predetermined limits. 

22. Apparatus according to any one of claims 15 to 21 in which the control means is 
arranged to select the quantization factors for blocks in a selected part of a still image 



21 



WO 02/09439 




PCT/EPO 1/08396 



to give a desired image quality and to select the quantization factors for the remainder 
of the still image on the basis of a desired data size for the complete encoded image. 

23. Apparatus according to any one of claims 15 to 22 in which the encoding and 

5 transmission of the still images is compatible with the scheme used for encoding and 
transmitting of the video sequence. 

24. A method for controlling the amount of data used to transmit still images, the 
method being suitable for use during the transmission of a video sequence from a first 

10 to a second location and comprising the steps of: 

intraframe encoding still images for transmission, the encoding process being one in 
which a still image is considered to comprise a plurality of blocks each of which is 
intraframe encoded; 

determining the data size of intraframe encoded blocks; and 
1 5 controlling encoding of selected blocks in dependence on the determined data size of 
one or more previously encoded block. 

25. A method according to claim 24 comprising the step of selecting a quantization 
factor for use in encoding of a selected block in dependence on the determined size of 

20 one or more previously encoded block. 

26. A method according to claim 24 or claim 25 comprising the step of selecting a 
quantization factor for use in encoding of a selected block by incrementing or 
decrementing a quantization factor used for a previously encoded block. 



27. A method according to claim 26 comprising the steps of: 

calculating the average data size of previously encoded blocks within the respective 
image; and 

selecting the quantization factor for use in encoding a selected block by incrementing a 
30 quantization factor used for a previously encoded block where the average data size 
falls on one side of a target range or value and by decrementing a quantization factor 
used for a previously encoded block where the average data size falls on an opposite 
side of the target range or value. 

35 28. A method according to claim 26 or claim 27 in which a maximum limit to the 
change in quantization factor caused by each incrementation or decrementation is 
chosen to limit undesirable visual effects in decoded images. 
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29. A method according to any one of claims 26, 27 and 28 in which the quantization 
factor is kept constant for a selected number of consecutive blocks, the selected 
number being chosen to limit undesirable visual effects in decoded images. 

5 30. A method according to any one of claims 24 to 29 in which the intraframe 
encoding of still images is conducted with the aim of keeping the data size of the 
encoded image within predetermined limits. 

31. A method according to any one of claims 24 to 30 comprising the steps of first 
1 0 selecting the quantization factors for blocks in a selected part of a still image to give a 
desired image quality and subsequently selecting the quantization factors for the 
remainder of the still image on the basis of a desired data size for the complete 
encoded image. 

15 32. A method according to any one of claims 24 to 31 in which the encoding and 

transmission of the still images is compatible with the scheme used for encoding and 
transmitting of the video sequence. 

33. Apparatus for controlling the amount of data used to transmit still images, the 
20 apparatus being suitable for use during the transmission of a video sequence from a 

first to a second location and comprising: 

encoding means arranged for intraframe encoding still images for transmission, the 
encoding process being one in which a still image is considered to comprise a plurality 
of blocks each of which is intraframe encoded; 
25 calculating means for determining the data size of part of an intraframe encoded image 
comprising at least one intraframe encoded block; 

judging means for determining whether the determined data size of said part of an 
intraframe encoded image falls within a preselected range; and 

control means for causing re-encoding of said part of an intraframe coded frame, prior 
30 to transmission, in such a way as to change the data size of said part of an intraframe 
coded image when the determined data size falls outside the preselected range. 

34. Apparatus according to claim 33 in which the control means is arranged to select 
quantization factors for use in encoding and re-encoding still images. 

35 

35. Apparatus according to claim 34 in which the control means is arranged to change 
the data size of said part of an intraframe coded image, when re-encoding said part, by 
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